DOCUMENT RESUME 



ED 081 453 



LI 004 461 



AUTHOR 
TITLE 



INSTITUTION 



SPONS AGENCY 

PUB DATE 
NOTE 



McGrath, William E. . 

An Estimate of the Amount of Research Required to 
Fill a New Journal of Library Science and Three 
Estimates of the Amount of Research Available. 
American Library Association, Chicago, 111. Library 
Research Round Table.; ERIC Clearinghouse on Library 
and Information Sciences, Washington, D.C. 
National Inst, of Education (DHEW) , Washington, 
D.C. 
May 72 

34p. ; (16 references); An oral summary of this paper 
was presented as a part of the Library Research Round 
Table program of the June 25 to July 1, 1972 Annual 
Conference of the American Library Association 



EDRS PRICE MF-$0.65 HC-$3.29 

DESCRIPTORS *Library Research; *Library Science; Periodicals; 

Research; Research Needs; Research Reviews 
(Publications) ; *Scholarly Journals 

ABSTRACi^ 

To help determine whether a new journal of library 
research is needed, three estimates of available research are 
compared with an average-sized journal in the library field. The 
average number of pages and articles per year (285 and 36) in sixteen 
primarily American library journals that publish at least an 
occasional research article were determined by a straightforward 
coiint. Three sources of research werti examined in order to estimate 
whether each had enough potential or available material each year to 
fill a new journal equivalent to the average-sized journal. The three 
sources were (1) Educational Resources Information 

Center/Clearinghouse on Library and Information Sciences (ERIC/CLIS) , 
(2) rejected but publishable material, and (3)' "LIST," "Library and 
Information Science Today. " The first, ERIC/CLIS, suggests that 
almost enough material is available, the second rejected but 
published barely enough to fill a new journal, and the third, "LIST," 
that there is ample potential if the articles are written. (Related 
documents are LI 004 460 and LI 004 462.) (Author/SJ) 



FILMED FROM BEST AVAILABLE COPY 



US DEPARTMENT OF HEALTH. 
E0UCATI0N4WELFARE 
NATIONAL INSriTUTEOF 
EDUCATION 

THIS DOCUMENT HAS BEEN REPRO 
OUCED EXACTLY AS RECEIVED FROM 
THE RERSON OR 0RGANIZ;».TI0N ORIGIN 
ATlNGiT POINTS OF VlfTW D« OPiNlDNS 
STATED 00 NOT NECESSARILY PEPBE 
SENT OFF ICi;iL NATIONAL INSTITUTE OF 
EDUCATION POSITION 0« POLICY 



M ESTIMATE OF THE AMOUNT OF RESEARCH 
REQUIRED TO FILL A NEV/ JOURNAL OF LIBRARY SCIENCE 
AND THREE ESTIMATES OF THE AMOUNT OF 
RESEARCH AVAILABLE 



William E. McGrath 
■Director of Libraries 
University of Southwestern Louisiana 
Lafayette, Louisiana 



Syracuse University 
Syracuse, New York 
May, 1972 



Ttifs pubtfctitfon was prepared pursuaht to a contract with the National Institute 
of Education, US. Department of Health, Education, and Welfare, Contractors 
undertaking such projects under government sponsorship are encouraged to 
express freely their judgment in professional and technical matters. Points of 
view or opinions do not, therefore, necessarily represent official National 
Institute of Education position or policy. 



Abstract 

To help determine whether a new Journal of library research 
is needed, three estimates of available research are compared 
with an average-sized journal in the library field. The average 
number of pages and articles per year (285 and 36) in sixteen 
primarily American library journals that publish at least an 
occasional research article were determined by a straightforward 
count. "Research article" was defined as fitting one of the 
broad categories of the "concerns of the philosophy of science," 
as listed by Scriven. Three sources of research were examined 
in order to estimate whether each had enough potential or avail- 
able material each ^'ear to fill a new journal equivalent to the 
average-sized journal. 

The three sources were (l) Educational Resources Information 
Center/Cleairinghouse on Library and Information Sciences (ERIC/ 
CLIS), (2) "'rejected but publishable" material, and (3) LIST ; 
Library and Information Science Today . A purposive or non- random 
sample of 89 ERIC/CLIS research documents with I967-I969 imprints 
were searched in the open literature. These documents were judged 
to fit at least one of the "concerns of science." An average of 
31 "unpublished but publishable" documents were estimated to be 
available each year. The number of papers rejected by editors 
is considered a measure of the demand for a new journal. Eleven 
of sixteen journal editors surveyed indicated that a minimum of 
38 articles per yeax* might be available for publication — but only 



if it is assumed that these articles are editorially acceptable. 
Of 58i+ U-S, and Canadian research projects in LIST , at least 
li+0 per year are estimated as potential Journal articles not 
otherwise published. The first, ERIC/CLIS, suf?;gests that almost 
enough material is available, the second ^^rejected but publish- 
able" barely enough to fill a new Journal, and the third, LIST ^ 
that there is ample potential if the articles ai^e written. 



I. Background and Statement of the Problem 

The central question addressed in this paper is, "Do we need a new 
research Journal in library science?" To answer that question, we need 
to know how much research exists in library science and how much is not 
currently being disseminated in existing Journals. 

The question, of course, raises a host of other questions including: 
What kind of Journal? On what subjects? How big a Journal? Cannot 
existing journals publish this research? 

Perhaps the most difficult question of all is "What is research?" 
What is research to the library historian may not be research to the library 
behaviorist. There are many definitions and a huge literature on-these sub- 
jects, and even in our relatively young discipline of library science there 
have been r.any — Jesse Shera's"^, for example. To include or exclude any 
body of work according to one definition or another is to invite disagree- 
ment. A procedure somewhat less susceptible to that hazard, perhaps, would 
be.' to list all the G^aantitative methods used and then to make a straight- 
for'aard count of the number of papers in each of the categories. Some- 
thing like this is being done in a systematic way by Pauline Atherton and 
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Jeffrey Katzer (Syracuse University School of Library Science). 

Nevertheless, a working definition of research is needed. In this 

paper, I will use throughout, as a rough guideline, the "concerns of sci- 

3 

ence" as listed and discussed by Scriven in the International Encyclopedia 
of Social Sciences . These concerns, which have come to be known by some as 
"logical empiricism" are: observation, description, definition, classi- 
fication , measurement , ei.perimentation , generalization , explanation , 
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prediction, evaluation and control of the (library) environment. For 
me, then, "library research" is logical empiricism in the library en- 
vironment. This working definition requires that any paper or project 
exariined should fit at least one of Scriven's "concerns of science." 
A paper on use of business libraries would fit our definition if it 
"predicts the effect of the stock market fluctuations on use of stock 
reports" with either real data collected on fluctuations and usage to 
support the prediction, or an explanation of how the prediction could 
be demonstrated. 

The strategy in t]\l-r» paper emerged from a seminar with Pauline 
Atherton and Jeffrey Katzer at the Syracuse School of Library Science, 
and was adopted because it var> "do-able" within the given time constraints. 

Briefly, tlie plan was to select a certain number of American library 
journals that publish at least an occasional article that fits the work- 
ing definition of research, and then to determine the rr^eim nuir.ber of 
articles and pages per year per journal. These means would then be re- 
garded as an average-sized Journal, and would serve as a base to compare 
the amount of research available. (This estimate is explained in 
Part III. ) 

The amount of research available or potentially available was esti- 
mated in three ways. The first was an estimate of the number of unpub- 
lished research documents processed by ERIC/CLIS for Research in Educa- 
tion (RIE)^, and explained in Part IV of this paper. The second was an 
estimate of the number of research papers rejected by the editors of the 
sixteen journals listed in Part III, and the third was an estimate of the 
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potential number of papers which would emerge from the projects in Paul 
Wasserman^s LIST; Library and Information Science Today , ^ The three esti- 
mates should either support or contradict each other. 

Certain assumptions were common to each of these estimates; (l) the 
papers of projects counted met .the working definition of research; 
(2) we were counting only papers which would not otherwise be published 
in a journal; and (3) the number of papers or projects so defined and 
counted would be publishable if there were a new research journal. 

On the other hand, no assumptions about what constitutes "quality" 
research are made in this paper, 
II. Review of the Literature 

This brief review is restricted to a search of the last five years, 
for references which discuss or bear directly on the need for a new 

research journal in library science. I will make no attempt to define 

k 

"library science" agreeing with L. J. Taylor that "...there is no body 
of literature that can be isolated as library science...." The search 
was confined to the usual indexes ( Library Literatur e, Information Sci- 
ence Abstracts , and Library Information Science Abstracts ) which in a 
sense themselves defined the subject and scope of the search. 

I have assumed that we are concerned with the need for aip American 
journal. There are several international and foreign journals ( Libri , 
Journal of Librarianship , etc^ which could perhaps absorb much research, 
and I have found several interesting comments about journals and research 
by British writers. 

I have restricted my search to the last five years , partly because 
in that time several new journals ( Journal of Library Automation , 



Joxirnal of Librariani-hi p, Learning Today ) have been established, and 

partly because the literature about library literature was sm^veyed five 
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years ago by Thompson Little. His survey included a list of library 
periodicals most cited, data on the increase in number of library science 
publications from I898-I966, and a summary of the criticism of library 
literature: (l) poor lit&rary style; (2) siiperfluity and repetition; 
(3) belaboring the obvious; {h) paucity of significantly new ideas; 
(5) absence of scholarly approach; (6) lack of evidence of reseai-ch. 

f Moon has laid similar and harsh criticism against existing period- 
icals and "scissors and paste research," the cutting up of old articles 
and pasting them together to r^al-ie new ones. "Perh&.ps the most construc- 
tive single thin?? that could be accomplished," says Mocn, "would be to 
persuade at least one in three public.hers of a library periodical to cease 
publication . " 

9 

More recently Saracevic has criticized the Annual Review of Infor- 
mation Science and Technolo gy ( ARIST ) for its extensive coverage of non- 
Journal literature. Saracevic regards report literature as uncitable 
because it is not subject to peer review. However, the report liter- 
ature is regarded as legitimate by others, if we are to take the number 
of citations and reviews lo ERIC documents as an indicator. Cuadra's"^^' "^"^ 
reply is that APIST ^ g authors '*use professional judgment- of a work^s 
value," which amounts to a kind of peer review. If there are a large num- 
ber of citable reports, then the question seems to be v;hether they would 
be more citable if they vere published in Journals. Cuadra seems to 
believe that the only difference in rct'orts and journal articles is length. 
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"Journals publish journal-size articles/' he says. 

In discussing the birth and death of several British journals, Edward 
12 

Dudley believes that, ...reporting new work is not yet a widely accepted 

13 

professional obligation...," and Fenichel found that journals cite jour- 
nals more than reports and reports cite reports more than journals. 

Katz , while surveying library school publications, concluded that 
desire to esta.blish a new journal is not "that there is no outlet" for 
unpublished material — rather it is to create publicity for the school, 

Lehnus ^ has made a study of the 5^0 articles appearing in Journal 

of Education for Librarianship in 1960-1970 to determine the "nature of 

contents", the sources on which the authors base their material, and if 

there is a research front among authors. His main findings were a list of 

authors with- three or more ai:ticles in the Journal of Education for 

Librarianship, a list of the principal Journals from which articles were 

cited, age of reference at time of citation, and authors who were cited 

at least three times. 
l6 

Berg states that pressure to start a new journal comes from "the 
gap between submitted and published research" and that the "number of 
research pages submitted by the researchers is affected by the existence 
of journals to publish the work." "Journal quality and demand are vari- 
ables which more directly affect the demand for subscriptions." With 
data from four journals, he uses multiple regression to test the demand 
model Q = f(P, X, N, j) where Q = demand (i.e., quantity, or circulation 
of the journal); P = price; X = number of pages published; N = number of 
researchers in the field, or the size of the audience; and. J = the n\imber 
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of Journals' in the field. He concludes for the Journal of Physical CheTnistry , 
that it is "undersized, given the a.pparent valuation of the additional pages 
by nonmer.bers 

Berg^s is the only paper found to address the question of journsLl size, 
but his paper was a.n "economic" analysis of demand, not an analysis of the 
research demand. Nevertheless, he offers an approach well worth careful 
study. His method is somewhat '.Tiore applicable to the readership of single 
journals than to the readership of an entire discipline, however. 
III. Esti m ate of Volume in Library Science Journals that Publish Research . 

Selection of journa.Vs for thir. ntudy was based partly on whether each 
journal published at lea^;t; rj.n occat;ional article which fit the working 
definition of research mentioned above and partly on whether they were 
American library journals that have a national circulation. Two excep- 
tions are: one international journal published domestically, Information 
Storage and Retrieval s and one foreign journal with some domestic circula- 
tion, Canadian Library Journal . (One could rightfully argue that such 
journals as Libri , Journal of Chemical Documentation , Journal of Documen- 
tataon. Research in Librarianship , Aslib Proceedings , and Journal of 
Librarianship should be included, since they apparently contain more 
research.) Regional Journals were excluded. No direct count of the num- 
ber of research articles was made, although the number is estimated later 
in this paper. Volume of present journals, which will later be compared 
to the volume of potential research, will be in terms of total and aver- 
age number of articles and the average number of pages per article for 
the last five years. The joui^nals sampled and total counts with means 
for each year (research and non-research) appear in Table I. 
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The counts in Table 1 shoiild be fairly reliable; k% of the data van 
extrapolated because a few periodical issues were not available for 
counting. Except for an occasional judgment as to what constituted an 
article — for instance-, signed introductions to Library Trends (counted) 
regular features in Journal of Library Histoid (not counted) — the source 
of bias should not be large. For the mean number of pages per article , 
the principal statistic in this count, the confidence interval (not com- 
puted) should be fairly narrow. 

The overall means for the 5-year period, including the principal 
statistics — the mean niomber of pages per Journal per year (285)5 the 
mean number of articles per journal per year (36) > and the mean number 
of pages per article (80) — are in Table 2. 
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Table 2 

Overall Means of Articles and Pages in Sixteen 
Journals for the 5-year Period, 1967-1971 - 



Articles per year 55^ 

Pages per year h ^h23 

Pages per journal per year 285 

Article.s per journal per year 36 

Pages per article 8.0 



Sui-jmary of Part III > 

Establishment of a journal shoiild not ^ of course, be based on some 
myi^hical mean number of articles or pages ^ but on the ajiiount of material 
needing to be published and the ability of t?ie journal to sustain itself 
through subscriptions, as suggested by Berg. If the n:c:an number of 
articles or pages is used, it should be on a compar-'it:^' "^.-.ii^ls only, as 
in this paper, since there can be conh^iderabl.e variability in the size 
of journals . 

The mean number of articles and pages, 36 and 205 respectively, in 

the sixteen journals surveyed is drawn in Figure 1, as an approximate 

goal to be reached by the other estimates in this paper. 

IV. Estimate of the Amount of Existing Unpublished Research fror.i 

ERI C/CLIS ' ' " ■ 

One large source of ^'unpublished" materiril lu-c iCAiC reports . A 

large nmber of these are cited in ARIST and other places . Since these 

documents are relatively easy to identify and are listed all in one 

place, they presented a population which could be sampled in a fairly 

short time. The idea hare was to estimate the number of ERIC/CLIS docu- 
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ments which were never subsequently published — the assumption being that 
this number presented a potential source of publishable material. The 
question of whether these documents should be published is not treated in 
this paper. 

Titles and abstracts of documents with I967-I969 imprints from the 
ERIC/CLIS input in the 196T through IQTO vol\mes of Research in Education 
were rapidly scanned and 89 of those judged to fit at least one of Scriven's 
i.Kiterrpries were chosen. Judgment was assisted when the titles or the 
abstracts indicated that an analysis had oeen made, or that there had been 
'^findings", studies sponsored by TJSP', OE, s.nd NLM, or any study with a 
contract or grant nujTiber seemed to fit the criteria more often tha.n studies 
without such identification. Excluded were anonymous papers, proceedings 
and transactions of conferences. Institutes, published documents from the 
Government Printing Office, many surveys of the type, "Survey of the 
libraries of the region of the State of ^\ proposals, develop- 

ment plans, pilot programs, annual reports, and di ssertationi3 (the latter 
could be studied separately). After all these exclusions '-i'e might expect 
few documents to meet the criteria, but at least 89 of 872 iocvjnents with 
I967-I969 imprints qualified and were traceab.le. 

The authors of the 89 documents were then thoroughly; searched in the 
following indexes : Current Index to Journals in Education , Information 
Science Abstracts , Library Literature , Psychological Abstracts , Reader^ s 
Guide to Periodical Literature , Social Science and Humanities Index , for 
the overall period 1966-19T1* An assumption substantially supported by 
the number of hits was that titles of the published articles would be 
similar if not identical to the original documents. KevertheleriF-^ the 

ERIC 
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following indexes were searched by subject for most of the remaining 
titles not found by author: A'^plied Science and Technology Index ^ Bio- 
logical and Agricultural Index , Business Periodical Index , Education 
Index , and P.A. I .S. Bulletin . Only one title was found by this method. 
Results of this author search are in Table 3- 



Table 3 

Number ERIC/CLIS Documents Searched 
and Published in Journals 





Imprint Year 




Published Also 




of 


K^omber 


in 




DocuTTient 


Searched 


Journal 




1967 


31 


9 




1968 


3h 


T 




1969 


2h 


5 


Mean 




29-30 


T 


Percent 




100^ 


23% 



A look at the titles of the journals in which many of ther.e docu- 
ments were published: American Libraries , V/ilson Library Journal , for 
example, which do not strictly ruiblish any research, cugf^es L.f^ that 
either some of these titles were not research after all, or that non- 
technical aspects for the f7;eneral reader were reported. (The editor 
of Wilson Library Bulletin ntate:'^ th it he invites rewritten research. 
See the survey of journals belov;.) 

To estimate the expected number of unpublished docioments , with a 
given imprint year which will appear in ERIC/CLIS, we must determine 
what proportion of the expected number the sample represents. To 
obtain that proportion, I counted the number of documents by imprint 
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year which have appeared in each year of Research in Education ( RIE ) . 
The numbers appear in Table k. The table shows that the number of docu- 
ments of a given imprint year are much higher in the second or third 
year of RIE than the first. 

I then recast these members from Table h in Table 5 according to 
whether a document of a given imprint yer.r appeared in RIE the same 
year, the year after and each subsequent year through the five yesirs 
studied. These niimbers were added across, and then divided by the num- 
ber of years in which there is data, to determine the arithmetic means, 
which are then used to approximate the missign data — the numbers in 
parentheses . It is then possible to compute for each imprint year the 
percent of the five-year total, represented by the number of documents 
appearing in the first, second. .. fifth years, respectively. Here we 
are interested only in 1967, I968, and I969. For 19^7, the proportion 
is the four-year total (because ve sampled RIE 19^7-1970) ^ divided by 
the total of 19^7 imprints, or 95%\ for. 1968, the three-year proportion 
(RIE 1968-1970) or 76^; for I969 , two-year proportion (RIE, 1969-70)^ or 
52^. 

The distribution of documents with a given imprint year over the 
five-year RIE sample for the number of documents appearing the first to 
fifth years seems to follow what is known about the utility distribution 
of docijcnents in general: i.e,, that circulation of documents rises rapidly 
the iiecond year and diminishes somewhat more slowly thereafter. 

The percentages 95^, 76^ and 52^ represent the proportion of docu- 
ments with a given imprint year that can be expected to appear in the 
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Table U 

Nimiber of ERIC/CLIS Documents by Their Imprint 
Year and by Publication Year of 
Research in Education 



InvDrint Year of Documents 



Research in Education 


1967 


1968 


1969 


1970 


1971 


Totals 


1967 


1* 










1 


1968 


105 


26 








131 


1969 


I3U 


18U 


U5 






363 


1970 


11 


35 


138 


62 




2I46 


1971 


Ik 


63 


116 


327 


129 


6I49 


Totalis 


265 


308 


299 


38q 


129 


1390 


Means 


53 


77 


100 


195 


129 


278 



* ERIC/CLIS documents not listed separately in I967 RIE . 



Table 5 

Distribution of Documents with a Given Imprint by 
Number of Documents Appearing in Same Year of RIE , and 
Each Subsequent Year. 
From Table U 
Missing data has been replaced with means 
in Parentheses , 



By Year of 



Appearance Imprint Year 



in RIE 


1967 


1968 


196? 


1970 


1971 


Total 


Mean 


Same Year 


1 


26 


h5 


62 


129 


263 


52 


Year After 


105 


18I4 


138 


327 


(182) 


75^^ 


182 


Sum 

Third Year 


13h 


35 


•183 
525?* 
116 


(96) 


( 96) 


289 


96 


Sum 




21^5 
767,* 












Foxirth Year 


11 


63 


(37) 


(37) 


( 37^ 


7i4 


37 


Sum 

Fifth Year 


251 
955?* 
Ik 


(lU) 


(1^0 


(li^) 


( IM 


Ik 


Ik 


Totals 


265 


322 


350 











* I.e., sum V total. 



Ik 



first four, first three and first two years respectively. These percent- 
ages are then interpolated in Table 6, to the smaller sample of documents 
that meet a research criterion. 

The expected number of ERIC/CLIS documents that meet minimal research 
criteria (Table 6, Col. E) is estimated using the results of Table 5, that 
is that 95^5 1^%^ and ^2% of. dociunents with a given imprint year will have 
been piok'=^d up in RIE in the first four years (1967-70 for 1967), first 
three years (1968-7O for 1968) and first two years (1969-7O for I969) 
respectively. The sample I searched (Col. C.) represents a mean of 6Q% 
of the expected number of research documents (Col. E) . Of these, in 
turn, 77^ are expected to be unpublished j since the author search (Table 3) 
shoved that 23% were published. 

Summary of Part IV 

The ERIC/CLIS potential is based on the assumption that the total 
nUTjber of ERIC/CLIS documents is not the total number of "publishable*' 
documents. We must reduce that number somehow;. e,g. , as we have done 
here on the basis of some criterion of research. The number is further 
reduced by the assumption that some of those "publishable^^ will indeed 
be published in existing journals. The conclusion is that, based on 
current input rate, an average of approximately 31 ERIC/CLIS documents 
of any given imprint year will be available for a new journal. (This is 
roughly 10^ to 11^ of the total ERIC/CLIS dociiments of a given imprint 
year.) This number may be regarded as a minimum and is drawn as such in 
Figure 1. 
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V. E stimate of Voluirie from Re.iected Papers 

If Berg, cited above, is correct in his assumption that the niimber 
of rejected papers in a given subject is an indication of the need for a 
new journal in that subject and if we ass\ime that those rejected papers 
are publishable, then we should make an effort to determine how many are 
currently being rejected. 

A sl-nple unpretested questionnaire (see Appendix II ) deliberately 
short to elicit the fastest response, was sent in late March to editors 
of 2h major, primarily American ^ library journals, including, the sixteen 
studied in Part III. The questionnaire was accompanied by a letter pre- 
senting Scriven^s definition of scientific research. Eleven responses 
(plus three, not listed^ stating that they did not accept scientific 
research) were received and summarized in Table 7- 



Table 7 



Number of Editors Reporting the Proportion 
of Research Papers Received and Rejected 
and Their Mean Percentages 



Scale 
None 



Author' s 

Arbitrary 

Transfor- 



mation 



Number of 
Editors Reporting 
Proportion of 
Research Papers"* 
Received 



Number of 
Editors Reporting 
Proportion of 
Research Papers 
Rejected 



0% 



0 
3 
2 
h 
1 
1 



1 
3 
2 



A few 
Some 
Many 
All 



Very few 



1-16^ 

35-66^ 
69-99^ 



3.5 
1.5 

0 



100^ 



Total 



11 



10 
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The scales for these responses were arbitrarily transformed to approxi- 
mate a normal distribution (the scale represents the normaJ- distribu- 
tion, not the responses). In a sense it forces the responses more 
nearly into a normal distribution. 

These percentage transformations are then applied to the mean niom- 
ber of articles and pages of each Journal (Table 8). For example. 
College and Research Libraries reported that '^some" of the articles it 
received were research. The author's transformation (35^-68^) of 
"some^^ in Coliamn D was multiplied by CRL ^ s mean annual articles and 
pages (Column E and F) , which in turn were multiplied by the author^s 
transformation (Column G) of the proportion rejected. The resulting 
estimate of articles and pages rejected appear in Columns H and I. Col- 
umns E, F, H and I v^ere then each separately summed down the column. 
The mean of each column for all eleven journEils was derived and extra- 
polated to fifteen journals. I.e., 

Total research articles received ~ Yi ' ^ 1^)2-251, 

Total research pages received = . F = 132^4-2163^ 

Total research articles rejected = • H = ^+8-1^+8, 

Total research pages rejected = ^ • I = i+19-1230. 
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Perhaps one more step in the final estimate of rejected material 
should be made. One editor estimates that, of the material his journal 
rejects, 20% t\irns up in other jo\irnals '*as rejected." Thus, if we 
use this percentage, oialy 80% of rejected material is available. The 
final estimates are in Table 9. 



Table 9 

Estimated Number of Research Articles Received, 
Rejected and Available Rejected 





A 


B 


C 




Expected 


Expected 


Rejected 




Number 


Number 


Articles 




Received 


Rejected 


Available 
(80^ of B)-^ 


Articles 


II42-251 


.U8-II48 


38-118 


Pages 


I32U-2163 


U19-I23O 


335-98U 



See text. 
Svimary of Part V 

The expected range of "rejected but publishable" articles and pages 
are U8-IU8 and U19-I23O, respectively. These estimates are based on the 
author's transformations of the editors' estimates, and on the necessao^y 
assumption that these rejected articles are publishable. These estimates 
are in turn reduced by another 20%, on the assumption suggested above 
that the percentage of rejected papers will turn up in other journals 
"as rejected". The minimums for these estimates, 38 and 335 respectively, 
are graphed in Figure 1. 

Part VI. Estimate of Potential Volume from L'ICT 

Paul Wasserman's LIST provides a new source from which it may be 



2k 



Articles 
150/ 
140/ 
130/ 
120/ 
110/ 
100/ 
90/ 
80/ 
70/ 
60/ 
50/ 
40/ 



Pages 

1200 

1120 

1040 

960 

880 

800 

720 

640 

560 

480 

400 

320 



30/ 
20/ 



10/ 



240 
160 
80 



(31) 



(38) 



(150) 



Needed to fill another 
journal--area below the 
dotted line represents 
an average-sized 
journal. 36 articles, 
285 pages. 



EHIC/CLIS Rejected ^ LIST 
Potential Potential Potential 



Fig. 1. Three independent estimates of additional material 

potentially available to fill a new journal — minimums 
expected. 
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possible to estimate the amount of research presently being done. LIST : 

Library and Information Science Today is a compendium containing descrip- 

IT 

tions of 820 world wide research projects defined by Wasserman as 
studies coiicernsd with "methodological, quantf.tative , or empirical work 
and oriented to laboratory or field work..." as well as "speculative or 
theoretical" studies, and reports of "innovation and experimentation" — 
dramatic departures "centering on method, scope, novel client response, 
unique and uncoinmon services, or any other new approaches to practice, 
teaching, or services in librai^ianship and information science," His 
definition is sufficiently broad to embrace mine and, judging from his 
statement that the "definition of innovation and experimentation was 
intentionally left hazy", he has probably, as have I, included projects 
that might otherwise not fit his definition. 

Of the 820 projects listed, 538 are American and h6 Canadian, The 
American and Canadian totals will be used together in this estimate, 

I have assumed that each of these projects will produce a minimum of 
one report (the mean is likely much higher) upon completion, Sut it is 
probably too generous to assume that all of these projects will be com- 
pleted in one yeair. In the absence of any data to show how many will, I 
have assumed that no more than one-third will be completed and thus 
reported in any one year. And using the same percentages I have used 
earlier with ERIC/Clin for those that will actually be published or 
unpublished {23% and 77^), I have summarized this argument in Table 10, 



V 
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Table 10 

Expected Niimber of LIST Projects Which 
Could Contribute to a New Journal 



Estimated 
Number that Estimat'-'i 





Total 


Estimated 


will be 


Number 




U.S. and 


Reportable 


Published 


Available 




Canadian 


in one 


in Existing 


for new 


Potential 


LIST 


Year 


Journals 


Journal 


Volume 


Projects 


(1/3) 


(23%)^ 


(77^)2 


Number 




19^+ 


h5 


150 


Pa^es-^ 


M6l2 


1552 


360 


1200 



1. From Table 3. 

2. 100^-23/J, 

3. Assuming each article is 8 pages in length/ 



Summai^y of Part VI 

There is a potential of at least 150 research articles per year 
which could be available if assumptions about the LIST data are reason- 
able. The 2"eader will have his own opinion as to whether this potent j.al 
is more or less likely to be fulfilled. 

VII. Summary and Conclusions 

Tlie estimates of average number of articles and pages and the three 
estimates .of potentially available material are summarized in Table 11 
and graphed in Figure 1. The graph shows that there should be almost 
enough material from ERIC/CLIS, barely enough from rejected articles and 
ample potential from LIST , to fill a journal the same size as the 
"average-sized** journal (dotted line, from Part Hi) in library science. 

These three sources should be regarded as not independent. That 
is, the estimates could be of the same material and should, therefore, 
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not be added to each other. In other words, since we do not know to what 
extent they overlap, it is most conservative to assume 100^ overlap. To 
put it another way, the bars in Figure 1 should not be placed end to end. 
A7lso, these estimates are all minimums , The actual number may be some- 
what larger. 

Although many of the assumptions in these estimates need empirical 
support 5 they are for the most part self-consi:':^tent and tend to be con- 
servative. These assiomptions have led to two c-?stimates which are fairly 
close to each other (ERIC/CLIS and '^rejected"), and an estimate for 
potential research ( LIST ) which is much larger than the other two- Inter- 
estingly, the first two are of projects which have been written up in some 
fashion, while the third is for projects presumably not yet written up. 
The large difference tends to lend support to the suspicion of many per- 
sons that much work never gets written up and certainly supports Edward 
Dudley's opinion, q^uoted earlier, that the obligation to report is not 
widespread. 

Important to remember is that the three estimates of potential 
material are minimums and fall within unknown confidence intervals. For 
the data here, they must be large. Although I speak of these estimates 
as minimijuns, even this assumption should be treated with caution. The 
one estimate which is more reliable is the mean number of articles and 
pages in the sixteen journals sampled. 

One last contribution toward our understariding of the ERIC/CLIS 
phenomenon: , DaaO ' Connor telephoned nine authors of the unpublished 




ERIC/CLIS reports asking them why their reports were not published. 
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(The small sample of nine was not a random selection. They were deliber- 
ately chosen for their accessibility, and they were all we were able to 
reach, given our budget restraints-) We hoped to find out whether or not 
the authors themselves felt that no Journal existed which would publish 
their reseetrch. Three reasons emerged. One person had intended to pub- 
lish but had suffered an incapacitating injury. Three had made no 
attempt to publish because they knew of no Journal which would publish 
their lengthy and statistics-laden documents, (This is one of the prin- 
cipal reasons for the 'establishment of ERIC/CLIS in the first place — 
raising the question, "Has the very existence of ERIC/CLIS prevented 
some good research from being published?") Five said that it had not 
occurred to them to publish. One of these replied that, now that we had 
mentioned it, he would consider publishing it — an interesting example of 
bias introduced by the i nvestiga.tor . 

In conclusion, the results of this quick study lead me to suggest, 
very cautiously, that there is enough material in the American library 
research environment to fill another Journal — perhaps a quarterly — or to 
fill an equivalent number of pages in an existing Journal - 
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APPENDIX I 



Tine constraints prevented a more empirical study. The following 
assumptions in this paper need additional empirical support; 



Part II. 



(l) that subject indexes such as Library Literature and Information 
Science Abstracts define the subject and scope of library sci- 
ence and information science; 



Part III. 



(2) that a new journal should have a number of articles and pages 
equal to the means of ey"!-dting journals; 

(3) that sources of bias in the article and page count and the con- 
fidence intervals are small; 



Part IV. 



{k) that ERIC/CLIS documents are representative of all unpublished 
reports in the library*" and information science field; 

(5) that reports later published in journals would be published with 
their titles unchanged; 

(5) that the distribution of documents with a given imprint year in 
each year of RIE follows a consistent pattern over a long period; 

(T) that the total documents of a given imprint year can be pre- 
dicted from that distribution; 



Part V. 



(8) that "rejected" papers are rejected because the journals to which 
they are submitted do not accept "that type" of research; 

(9) that papers so rejected would be otherwise publishable, if the 
appropriate research journal were available; 

(10) that proportions of research articlves received and rejected (as 
reported by the editors) are distributed on a normal curve (as 
transformed by the author); 



(11) that the number of rejected articles which turn up in other 
journals is 20% or any other percent; 
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Part VI . 

(12) that one-third (or any other proportion) of LIST projects will 
be completed in any one year; 

(13) that each of these projects will produce at least one report; 

(1^) that 77^ (generalization from Part IV) of those completed and 
written up will not be published in a journal; 

Part VII. 

(15) that the three sources of available material do not overlap. 



In addition to testing the above assumptions, a useful project would 
be to survey a random selection of unpublished ERIC/CIjIS authors to deter- 
mine the reasons why their reports were not published. If the number who 
respond that "no journal exists which accepts this type of work" is large 
enough, this would lend support to the need for a new journal. 
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APPE^IDIX II 
LRRT QUESTIONNAIRE ON LIBRARY JOURNALS 

1. Does your periodical accept papers reporting scientific library 
research? 

Yes I^o 

2. If answer to question 1 Is yes, does your policy include peer 
(referee) review of papers? 

Yes No 

3. VThat proportion of all the papers you receive for review would 
you classify as research? 

None Very Few A Few Some 

Many All 

k. Of the research papers you do receive (question #3), what propor- 
tion do you reject? 

None Very Few A Few Some 

Many Ml 



